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Abstract. We consider the convex optimization problem P : min x {/(x) : 
x £ K} where / is convex continuously differentiable, and K C K n is a com- 
pact convex set with representation {x G R n : gj(x) > 0, j = 1, . . . , m} for 
some continuously differentiable functions (gj). We discuss the case where the 
gj 's are not all concave (in contrast with convex programming where they all 
are). In particular, even if the gj are not concave, we consider the log-barrier 
function M with parameter fi, associated with P, usually defined for concave 
functions (gj). We then show that any limit point of any sequence (x M ) C K 
of stationary points of </>p, /i — ¥ 0, is a Karush-Kuhn- Tucker point of problem 
P and a global minimizer of / on K. 



1. Introduction 

Consider the optimization problem 

(1.1) P: /*:= min{/(x) : x e K}. 

X 

for some convex and continuously differentiable function / : M™ — > R, and where 
the feasible set K C K" is defined by: 

(1.2) K:={xeR": 5j (x)>0, j = l,...,m}, 

for some continuously differentiable functions gj : 1" — > K. We say that (gj), 
j = 1, . . . , m, is a representation of K. When K is convex and the (gj) are concave 
we say that K has a convex representation. 

In the literature, when K is convex P is referred to as a convex optimization 
problem and in particular, every local minimum of / is a global minimum. However, 
if on the one hand convex optimization usually refers to minimizing a convex func- 
tion on a convex set K without precising its representation (gj) (see e.g. Ben-Tal 
and Nemirovsky 1, Definition 5.1.1] or Bertsekas et al. [3, Chapter 2]), on the other 
hand convex programming usually refers to the situation where the representation 
of K is also convex, i.e. when all the gj's are concave. See for instance Ben-Tal and 
Nemirovski [TJ p. 335], Berkovitz [21 p. 179], Boyd and Vandenberghe (Hp. 7], 
Bertsekas et al. (3J §3.5.5], Nesterov and Nemirovski [T3J p. 217-218], and Hiriart- 
Urruty [11] . Convex programming is particularly interesting because under Slater's 
condition^, the standard Karush-Kuhn- Tucker (KKT) optimality conditions are not 
only necessary but also sufficient and in addition, the concavity property of the gj 's 
is used to prove convergence (and rates of convergence) of specialized algorithms. 
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^Slater's condition holds if gj(xo) > for some xo S K and all j = 1, . . . ,m. 
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To the best of our knowledge, little is said in the literature for the specific case 
where K is convex but not necessarily its representation, that is, when the functions 
(gj) are not necessarily concave. It looks like outside the convex programming 
framework, all problems are treated the same. This paper is a companion paper to 
[12) where we proved that if the nondegeneracy condition 



holds, then x G K is a global minimizer of / on K if and only if (x, A) is a KKT point 
for some A G R™ 1 . This indicates that for convex optimization problems (|l.ip . and 
from the point of view of "first-order optimality conditions", what really matters 
is the geometry of K rather than its representation. Indeed, for any representation 
(gj) of K that satisfies the nondegeneracy condition (|1.3|) . there is a one-to-one 
correspondence between global minimizers and KKT points. 

But what about from a computational viewpoint? Of course, not all representa- 
tions of K are equivalent since the ability (as well as the efficiency) of algorithms 
to obtain a KKT point of P will strongly depend on the representation (gj) of K 
which is used. For example, algorithms that implement Lagrangian duality would 
require the (gj) to be concave, those based on second-order methods would require 
all functions / and (gj) to be twice continuous differentiable, self-concordance of a 
barrier function associated with a representation of K may or may not hold, etc. 

When K is convex but not its representation (gj), several situations may oc- 
cur. In particular, the level set {x : <7 3 *(x) > aj} may be convex for a,j = but 
not for some other values of aj > 0, in which case the gj's are not even quasi- 
concave on K, i.e., one may say that K is convex by accident for the value a = 
of the parameter a > 0. One might think that in this situation, algorithms that 
generate a sequence of feasible points in the interior of K could run into prob- 
lems to find a local minimum of /. If the — <?j's are all quasiconvex on K, we 
say that we are in the generic convex case because not only K but also all sets 
K a := {x : 3j(x) > a.j,j — l,...,m} are convex. However, quasiconvex func- 
tions do not share some nice properties of the convex functions. In particular, 
(a) V(7j(x) = does not imply that gj reaches a local minimum at x, (b) a local 
minimum is not necessarily global and (c), the sum of quasiconvex functions is not 
quasiconvex in general; see e.g. Crouzeix et al. [5j p. 65]. And so even in this case, 
for some minimization algorithms, convergence to a minimum of / on K might be 
problematic. 

So an interesting issue is to determine whether there is an algorithm which 
converges to a global minimizer of a convex function / on K, no matter if the 
representation of K is convex or not. Of course, in view of [12j Theorem 2.3], a 
sufficient condition is that this algorithm provides a sequence (or subsequence) of 
points (xfc, Afc) € E" x converging to a KKT point of P. 

With P and a parameter [i > 0, we associate the log-barrier function ip^ : K —y 
R U {+00} defined by 



(1.3) 



Vj = 1, . . . ,m : 



Vgj(x) ^0 Vx G K with gj (x) = 



Til 



(1.4) 




+00, otherwise. 
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By a stationary point x £ K of we mean a point x £ K with <?j(x) ^ for all 
j = 1, . . . ,m, and such that V<^ t (x) = 0. Notice that in general and in contrast 
with the present paper, M (or more precisely Vv := M^m) ^ s usually defined for 
convex problems P where all the g^s are concave; see e.g. Den Hertog [6] and for 
more details on the barrier functions and their properties, the interested reader is 
referred to Giiler [9] and Giiler and Tuncel [10] . 

Contribution. The purpose of this paper is to show that no matter which 
representation (gj) of a convex set K (assumed to be compact) is used (provided 
it satisfies the nondegeneracy condition (jl.3l) ). any sequence of stationary points 
(xp) of (j>n, fj, — y 0, has the nice property that each of its accumulation points is 
a KKT point of P and hence, a global minimizer of / on K. Hence, to obtain 
the global minimum of a convex function on K it is enough to minimize the log- 
barrier function for nonincreasing values of the parameter, for any representation 
of K that satisfies the nondegeneracy condition (|1.3|) . Again and of course, the 
efficiency of the method will crucially depend on the representation of K which 
is used. For instance, in general M will not have the self-concordance property, 
crucial for efficiency. 

Observe that at first glance this result is a little surprising because as we already 
mentioned, there are examples of sets K a := {x : <7j(x) > ctj, j — 1, . . . , m} which 
are non convex for every ^ a > but K := Kq is convex (by accident!) and (|1.3[) 
holds. So inside K the level sets of the g/s are not convex any more. Still, and 
even though the stationary points x^ of the associated log-barrier cj)^ are inside K, 
all converging subsequences of a sequence (x M ), ^ — > 0, will converge to some global 
minimizer x* of / on K. In particular, if the global minimizer x* £ K is unique 
then the whole sequence (x^) will converge. Notice that this happens even if the 
<7j's are not log-concave, in which case may not be convex for all fi (e.g. if / is 
linear). So what seems to really matter is the fact that as \i decreases, the convex 
function / becomes more and more important in </> M , and also that the functions gj 
which matter in a KKT point (x*, A) are those for which gj(x*) = (and so with 
convex associated level set {x : gj(x) > 0}). 

2. Main result 
Consider the optimization problem (|1 . 1[) in the following context. 

Assumption 1. The set K in (|1.2[) is convex and Slater's assumption holds. Mo- 
rover, the nondegeneracy condition 

(2.1) Vft(x) ^ Vx £ K such that .^ (x) = 0, 

holds for every j = 1, . . . , m. 

Observe that when the g^s are concave then the nondegeneracy condition (|2.1j) 
holds automatically. Recall that (x* , A) £ K x R m is a Karush-Kuhn- Tucker (KKT) 
point of P if 

• x £ K and A > 

• Aj5j(x*) = for every j = 1, . . . ,m 
. V/(x*) -E7= 1 A i V ft (x*)=0. 

We recall the following result from [T2"] : 
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Theorem 1 ( [12j). Let K be as in and let Assumption^ hold. Then x is a 

global minimizer of f on K if and only if there is some A G R" 1 such that (x, A) is 
a KKT point of P. 



The next result is concerned with the log-barrier <^ in (|1.4[) . 

Lemma 2. Let K in il.ty) be convex and compact and assume that Slater's condi- 
tion holds. Then for every \x > the log-barrier function (j)^ in \1.J$ has at least 
one stationary point on K (which is a global minimizer of (j)^ on Kj. 

Proof. Let /* be the minimum of / on K and let fi > be fixed, arbitrary. We first 
show that M (xfc) — > oo as x^, — » dK (where (x^) C K). Indeed, pick up an index 
i such that gi(x.k) — > as k — > oo. Then </v( x fc) > /* — /ilng^Xfc) — (m — 1) InC 
(where all the g/s are bounded above by C). So M is coercive and therefore must 
have a (global) minimizer x p G K with gj(x^) > for every j = 1, . . . ,m; and so 
V0„(x M ) = O. , ■ , q 

Notice that ^ may have several stationary points in K. We now state our main 
result. 

Theorem 3. Let K in U.2\) be compact and let Assumption[l\hold true. For every 
fixed fi > 0, choose x^ G K to be an arbitrary stationary point of <f>^ in K. 

Then every accumulation point x* G K of such a sequence (x M ) C K with fi — > 0, 
is a global minimizer of f on K, and if V/(x*) =/= 0, x* is a KKT point of P. 

Proof. Let x M G K be a stationary point of , which by Lemma [2] is guaranteed 
to exist. So 

m 

(2.2) V^(x M ) - V/(x„) - ]T V Si (x M ) = 0. 

7=1 I*) 

As /i — > and K is compact, there exists x* £ K and a subsequence (/if) C K.+ 
such that x w — )■ x* as f — > oo. We need consider two cases: 

Case when <?j(x*) > 0, Vj = l,...,m. Then as / and c/j are continuously 
diffcrentiable, j = 1, . . . ,m, taking limit in (|2.2j) for the subsequence (/^), yields 
V/(x*) = which, as / is convex, implies that x* is a global minimizer of / on 
R™, hence on K. 

Case when gj(x*) = for some j £ {1, . . . , m}. Let J := {j : <7j(x*) = 0} 7^ 0. 
We next show that for every j G J, the sequence of ratios (/i/<7j(x w ), £ = 1, . . ., 
is bounded. Indeed let j £ J be fixed arbitrary. As Slater's condition holds, let 
xo G K be such that <?j(xo) > for all j = 1, . . . , m; then (Vpj(x*), xo — x*) > 0. 
Indeed, as K is convex, (V<7j(x*),Xo + v — x*) > for all v in some small enough 
ball B(0,p) around the origin. So if (V.9-, (x*), x - x*) = then (Vsfj(x*), v) > 
for all v G B(0, p), in contradiction with V^(x*) 7^ 0. Next, 

rn 

<V/(x w ),xq -x*) = V] (Vg fc (x w ),x -x*) 

^ 5fe(x M J 

> 7- r {Vflj(x w ),Xo-x*), £=1,..., 

where the last inequality holds because all terms in the summand are nonnegative. 
Hence, taking limit as £ — > 00 yields 

(V/(x*),x -x*) > <Vg,(x*),x -x*) x lim —^r, 

t-Hx> gj (x w ) 
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which, as j € J was arbitrary, proves the required boundedness. 

So take a subsequence (still denoted {nt)i for convenience) such that the ratios 
/i/<7j(x^) converge for all j £ J, that is, 

lim j 1 - = A 7 > 0, Vj £ J, 

and let Aj := for every j $ J, so that Aj<7j(x*) = for every j = 1, . . . , m. Taking 
limit in (|2.2p yields 



(2.3) V/(x*) = 5>iV#(x*), 

3=1 

which shows that (x*, A) S KxK™ is a KKT point for P. Finally, invoking Theorem 
[TJ x* is also a global minimizer of P. □ 

2.1. Discussion. The log-barrier function 0^ or its exponential variant /+// X) .97 1 
has become popular since the pioneer work of Fiacco and McCormick [5] , where 
it is assumed that / and the gj's are twice continuously differentiable, the gj's are 
concav^E Slater's condition holds, the set K(~l{x : /(x) < k} is bounded for every 
finite k, and finally, the barrier function is strictly convex for every value of the 
parameter /i > 0. Under such conditions, the barrier function / + fJ-^gJ 1 has a 
unique minimizer x M for every \i > and the sequence (x^, (/x/gj(x^) ) C R ra+m 
converges to a Wolfe-dual feasible point. 

In contrast, Theorem [3] states that without assuming concavity of the <?j's, one 
may obtain a global minimizer of / on K, by looking at any limit point of any 
sequence of stationary points (x M ), \i — > 0, of the log-barrier function ^ associated 
with a representation (gj) of K, provided that the representation satisfies the non- 
degeneracy condition (jl.3l) . To us, this comes as a little surprise as the stationary 
points (x M ) are all inside K, and there are examples of convex sets K with a rep- 
resentation (<7j) satisfying (11.31) and such that the level sets K a = {x : <?j(x) > aj} 
with aj > 0, are not convex! (See Example [T]) Even if / is convex, the log-barrier 
function need not be convex; for instance if / is linear, V 2 ^ = — ^ 2 m 5jj 
and so if the g^s are not log-concave then 4>)i may not be convex on K for every 
value of the parameter \i > 0. 

Example 1. Let n — 2 and K a := {x G M 2 : g(x) > a} with x H» g(x) := 
4 — ((:ei + l) 2 + x?,)((xi — l) 2 + x\), with a e R. The set K a is convex only for 
those values of a with a < 0; see in Figure [T] It is even disconnected for a = 4. 

We might want to consider a generic situation, that is, when the set 

K a := {x € R n : 3j (x) > a if j = 1, . . . , m}, 

is also convex for every positive vector < a = (aj) € M m . This in turn would 
imply that the are quasiconcav^ on K. In particular, if the nondegeneracy 
condition (|1.3p holds on K and the g^s are twice differentiable, then at most one 
eigenvalue of the Hessian V 2 gj (and hence V 2 lngj) is possibly positive (i.e., \ngj 



2 In fact as noted in [7], concavity of the gj's is merely a sufficient condition for the barrier 
function to be convex. 

■^Recall that on a convex set O C EE", a function / : O — > R is quasiconvex if the level sets 
{x : /(x) < r} are convex for every r £ R. A function / : O — > R is said to be quasiconcave if 
— / is quasiconvex; see e.g. [5]. 
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Figure 1. Example Q] Level sets {x : g(x) = a} for a = 
2.95,2.5,1.5,0 and -2 

is almost concave). This is because for every x 6 K with gj(x) — 0, one has 
(v, V 2 j 3 (x)v) < for all v G V.g i (x) ± (where Vft(x) 1 - := {v : (Vft(x),v) = 0}). 
However, even in this situation, the log-barrier function </> M may not be convex. On 
the other hand, In gj is "more" concave than gj on IntK because its Hessian S7 2 gj 
satisfies ff|V 2 \ngj = gjV 2 gj — Vgj (Vgj) T . But still, gj might not be log-concave 
on IntK, and so may not be convex at least for values of fj, not too small (and 
for all values of fi if / is linear). 

Example 2. Let n — 2 and K := {x : g(x) > 0,x > 0} with x i-» g(x) = x±X2 — 1. 
The representation of K is not convex but the g/s are log-concave, and so the 
log-barrier x m (x) := fx) — /i(lng(x) — hixi — rnxa) is convex. 

Example 3. Let n = 2 and K := {x : g\ (x) > 0; a — x\ > 0; < X2 < 6} with 
x i— > ,9i (x) = x\/{e + a; 2 ,) with e > 0. The representation of K is not convex and g\ 
is not log-concave. If / is linear and e is small enough, the log-barrier 

x i-> (/> M (x) := /(x) — /^(lnxi + ln(a — xi) — ln(e + a; 2 ) + I11.T2 + ln(6 — X2)) 

is not convex for every value of /i > 0. 

Acknowledgement. The author wishes to thank two anonymous referees for point- 
ing out a mistake and providing suggestions to improve the initial version of this 
paper. 
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